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The replicator equation is ubiquitous for many areas of mathematical biology. One of major 
shortcomings of this equation is that it does not allow for an explicit spatial structure. Here 
we review analytical approaches to include spatial variables to the system. We also provide a 
concise exposition of the results concerning the appearance of spatial patterns in replicator reaction- 
diffusion systems. 
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Abstract 



1 Replicator equation 



The now classical replicator equation arises naturally in several important evolutionary contexts [30, 
[3Tj 140] . The most straightforward way to write down the replicator equation is to start with a 
symmetric two player game with a payoff matrix A = (aij)fe X fe) where a^- denotes the payoff of player 
one if player one uses pure strategy i against pure strategy j used by player two. Let p = (p%, . . . ,pk) 
denote a mixed strategy, which belongs to the simplex = {p £ l fe : YliPi = 1> Pi ^ 0> i = 1, . . . , A;}. 
The average payoff of pure strategy i against p is (Ap); = . a^pj, and the average payoff of mixed 
strategy q against p is (q, Ap) = ^ t 9«(Ap)i = YLij a ijPiQj- 

For the following we will need the notion of the Nash equilibrium. The Nash equilibrium of the 
game with the payoff matrix A is defined as such strategy p € Sk that fares best against itself, i.e. 

(p,Ap) < (p,Ap), (1) 

for any p G Sk- 
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Now let us identify the payoff of a game with an individual's fitness and instead of two players 
consider a populations of players, each of which can use one out of k different strategies (these strategies 
can be mixed in general, but at this point it is more transparent to assume that the strategies are 
pure). The reproductive success of an individual using strategy i depends on its average payoff (Ap)j 
assuming random encounters with other individuals. Here p S Sk is the current structure of the 
population, pi = rii/N, where rn is the absolute number of players using strategy i and N = J2j n j is 
the total population size. We obtain, in a usual manner, that 

-^ = (Ap) i , i = l,...,k. (2) 

System ([2]) can be called a selection system, according to the general terminology [Ml [35] . If instead 
of absolute sizes we consider the corresponding frequencies, system ([2]) reduces to 

Pi =p;((Ap)j - (p, Ap)), i = l,...,k. (3) 

Equation (j^J) in this general form was written down first in [32] and was dubbed "replicator equation" 
in [30] ; particular cases of fl3J) were considered previously in the population genetics [301 HI] an d in 
the mathematical theories of prebiotic molecular evolution [U l21~l [22"1 [23] . Note that if a solution to 
system is known then the corresponding solution to ([3]) can be calculated. In general different 
selection systems of the form (|2|) correspond to the replicator equation ((3|); e.g., instead of (Ap)j one 
can consider the fitness of the form (Ap); + F(N), where F is an arbitrary function (see also [35j). 

There exists a parallel between the concepts of game theory with the payoff matrix A and the 
behavior of the solutions to the replicator equation (|3j). For example, if p € Sk is a Nash equilibrium 
then p is a stationary point of ([3]). If p is a stationary point of ([3]) and Lyapunov stable then p is a 
Nash equilibrium. 

Another important notion of the game theory is that of evolutionary stable strategy (ESS). Strategy 
p is called ESS if ([I]) holds for any p G Sk and, additionally, for all p ^ p such that (p, Ap) = (p, Ap) 
it is true that (p, Ap) < (p, Ap). It can be proved that the last two conditions are equivalent to 

(p,A P ) > (p,Ap) (4) 

for all p € Sk from some neighborhood of p. With some abuse of notation a stationary point p of ([3]) 
is called an evolutionary stable state (and abbreviated the same ESS) if @ holds; being ESS implies 
that p is asymptotically stable (the opposite is not true). 

Equation (|3|) is unrealistic in that it ignores the population structure, all the individuals using the 
same strategies are supposed to be identical, the population itself being well mixed. The population 
structure can have different nature, e.g., the contact structure, age structure, physiological structure, 
etc |37[ 138] . One extremely important structural variable is the space |20] , Among different modeling 
approaches to include the spatial structure in the model, reaction-diffusion equations take an important 
part H2]. 

2 Reaction-diffusion replicator equation 

The usual tactics to consider mathematical models with explicit spatial structure is to replace a system 
of ordinary differential equations 

h = f(n) 
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with the system of partial differential equations of the form 

d t n = f (n) + DAn, 

where D is a diagonal matrix of diffusion coefficients and A is the Laplace operator. This approach 
however fails in general with the replicator equation ([3]) because there is an additional condition that 
p € Sk- The only case when this condition can be met is when all the diffusion coefficients are identical 
(this case is a generalization of the classical work |27j). In this case we obtain the following system of 
reaction diffusion equations 

dtPi =Pi((Ap)i - (p, Ap}) + dApi, i = l,...,k, (5) 

that was studied in [28J together with the boundary conditions d\pi = 0, where 1 is the normal to the 
boundary of the domain in which the solution to ([5]) is sought, we denot this domain VL. 
The following main result concerning ([5]) was proved in [28 1 : 

Theorem 1. Let system ([3]) have an inner asymptotically stable stationary point p € int St = {p € 
Sk '■ p > 0}. Then p is a globally asymptotically stable stationary point of © for any diffusion 
coefficient d. 

There are several possible approaches to study the replicator equation with explicit space with 
different diffusion coefficients. The first approach by Vickers and co-authors uses the principle of local 
population regulation such that the fitness values are adjusted in such a way so that the total local 
population size stays constant [26l [32], [33j [43] [44] [45] . To be more precise, as a counterpart of ([3]) 
Vickers et si. consider the system 

d t ni = nj((Ap)i - (p, Ap)) + diApi, i = l,...,k, (6) 

which is written for the absolute sizes nj(x,t), where xgUc M m , m = 1,2,3. System ([6]) should be 
supplemented with the initial and boundary conditions. 

Another approach by Cressman and co-authors |13t [T4"] [39] is to consider system ([2]) first and then 
add the space. This approach also uses absolute sizes for the subpopulations using different strategies: 

dm = fii((Ap)i + F(N)) + d,A Pt , i = l,...,k, (7) 

where F is typically a smooth decreasing function. A similar approach to consider "open" replicator 
systems is discussed in [7]. 

Both systems ([6]) and ([7} are equivalent to the replicator equation ([3|) when there is no spatial 
structure, however they have remarkably different behaviors for di > (see below). 

Finally, another approach was used in [H [91 [TO] [HI US] to study a spatially explicit counterpart of 
the replicator equation ([3]). In short, we start with the system for the absolute sizes 

hi = m(Ap)i + diApi, i = l,...,k, 

and use the transformation pi = rii/Y2j Jq n j( x ) t) ^ x to obtain 

d m = pi [(Ap), - f"P(t)] + d { A Pi , i = 1, . . . , k. (8) 
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Here pi = Pi(x, t), x G O, c?t = £ , A is the Laplace operator, and > 0, i = 1, . . . , k are the diffusion 
coefficients. The initial conditions are Pi(x, 0) = </>i(x), i = 1, . . . , k, and 



Solutions to ([8]) now belong to the analog of the simplex Sfc(Ot), Jli = Slx [0, oo) and for any time 
moment t are assumed to belong to the Sobolev space W^fi) and satisfy condition (fTUj) , 

Formally, system ([8]) can be obtained from ([7]) if we assume that N = N(t) = ]T\ /^(x^chc, 
therefore the results for systems ([7]) and (JS]) should be similar. 

We are mostly interested in the steady state solutions to the replicator reaction-diffusions systems. 
Of especial interest is the stability of spatially homogeneous stationary points, which are also stationary 
solutions to the replicator equation ([3]). For systems © and (|7|) it is possible to study also traveling 
wave solutions, but these particular kinds of solutions are not considered here (see for an extensive 
discussion, e.g., [H 123 HE (2H1 E21 M)- 

3 Turing instabilities and spatial patterns in replicator reaction- 
diffusion systems 

Let us assume that p £ int S% is an ESS for the game with payoff matrix A. Then it is an asymptotically 
stable state of the replicator equation ([3|). This stationary point is also a spatially homogeneous 
stationary solution for the systems (J7J), ([8j) (with some choice of N = N) and ©. Will this solution 
be asymptotically stable for the spatially explicit systems? 

For the system ([6]) Vickers [13] proved the following theorem: 

Theorem 2. Let p be an ESS of the game with the payoff matrix A. Then n = Np is an asymptotically 
stable spatially homogeneous stationary solution to ([6]) for any diffusion coefficients. 

If p € intS'fc, Theorem [2] is a generalization of Theorem [TJ The major difference of system (J7J) is 
that an ESS can become unstable for the system with the space. In general, it holds that 

Theorem 3. Let p be an ESS of the game with the payoff matrix A. Then n = Np is a spatially 
homogeneous solution to ([TJ, which can become unstable in spatially explicit system for a particular 
choice of A and diffusion coefficients. 

Several theorems on the behavior of the ESSs, which specify exact conditions on the appearance 
of the spatial patterns for particular cases k = 2, 3 can be found in [14] . 

Using system (|8|) it is possible to give more exact general statements concerning appearance of 
the spatially inhomogeneous solutions [9| 110] rTT] . In particular, the following necessary condition was 
proved in [IT] . 




(9) 



For the system ([8]) we have the condition of the global regulation 




(10) 
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Theorem 4. Let p G int S n be an asymptotically stable rest point of ([3]) . Then for this point to be 
an asymptotically stable homogeneous stationary solution to ([8]) it is necessary that 

y>>f-> /3=(a p , p), (ii) 

where \\ is the first non-zero eigenvalue of the following eigenvalue problem 

A^(x) + A^(x) =0, x G n, 8^1^ = 0. 

Theorem H] points out that to expect an appearance of spatially inhomogeneous solutions the 
diffusion coefficients have to be sufficiently small. For some particular choices of A it is possible to 
give an exact conditions for the appearance of spatial patterns [9l[TU]. In particular, consider matrix 
A of the form 

/oi ... 0\ 
A= a 2 ... 

\0 ... aj 

then (see [TO] ) 

Theorem 5. There exists a spatially non-uniform stationary solution to (J8j) with the given A in case 

of n = [0,1] if 

Edi 1 
Oi 7T 2 

i 

Moreover, using the special hamiltonian form of the equations for the stationary solutions to ([8]) 
it is possible to obtain a parametric form for these spatially non-uniform solutions [9l I10j. 



4 Distributed Nash equilibrium and evolutionary stable state (DESS) 

Since the appearance of spatially heterogeneous solutions in system (|8|) is a generic phenomenon, it is 
necessary to study the asymptotic behavior of the distributed system, especially given the fact that 
for some values of the diffusion coefficients there are no stable spatially homogeneous solutions in 
the system. We approached this problem by considering a generalization of the notions of the Nash 
equilibria and ESS to the spatially explicit case [TT] . 

Definition 1. We shall say that the vector function w(x) G Sk(Q) is a distributed Nash equilibrium 
if 

/ (u(x,i), Aw(x))dx < / (w(x), Aw(x))dx (12) 
Jn in 

for any vector- function u(x, t) G Sk(^t), u ( x , t) ^ w(x). 

Definition 2. We shall say that w(x) G <Sfc($7) is a distributed evolutionary stable state (DESS) if 

/ (w(x), Au(x,i))dx > / (u(x,t), Au(x,t))dx (13) 
for any u(x, t) G Sk(£lt) from a neighborhood o/w(x) G Sk(£l), u(x, t) ^ w(x). 
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We also need the following stability notion 

Definition 3. Stationary solution w(x) € Sfe(O) to ([8]) is stable in the sense of the mean integral 
value if for any e > there exists 5 > such that for the initial data (fi(x) of system ([5]) ; which satisfy 

\ipi -Wi\<5, i = l,...,n, 

where 

<Pi= tfi(x)dx, Wi= Wi(x)dx, 
Jn Jn 

it follows that 

\Ui(t) -U!i\ <£ 

for any % = 1, . . . , n and t > 0. 

Here u~i(t) = J~ Ui(x, t) dx and Ui(x, t), i = 1, . . . , n are the solutions to (|8]) ; u(x, t) € Sk(£lt)- 

Using these definitions we can prove the following theorems [11] 

Theorem 6. If w(x) € intSfc(O) is a Lyapunov stable stationary solution to (JH]) then w(x) is a 
distributed Nash equilibrium. 

Theorem 7. Let w € int 6e a spatially homogeneous solution to (|8j) (i.e., w G int 5^ is a rest point 
of {H])). If w is DESS then w is an asymptotically stable solution to ([8]) in the sense of the mean 
integral value. 

In words, Theorem[7] implies that if p € Sk is an ESS, then the corresponding spatially homogeneous 
solution will stay stable, albeit in the weaker mean integral sense if p is DESS. The sufficient condition 
of being DESS is given by 

Theorem 8. The stationary point p £ int Sk is a DESS if 

(Ac (t),c°(t))<-7 2 |c°(t)| 2 , 7 >0 (14) 
for any c°(t) satisfying c®(t) = 0. 

Proof of Theorem [8] can be found in [11] together with some examples. 

5 Discussion 

Here we give a short review of the analytical work on the replicator reaction-diffusion equations. There 
are different approaches to include the explicit space in the replicator equation ([3]). One of them, by 
Vickers et al., supposes that there is local regulation of the population. While this approach yields 
simple results (see Theorem [2]) concerning the appearance of spatial patterns, it is difficult to assume 
that the principle of local regulation is abundant in real systems. The approach used by Cressman and 
co-authors (equation [131 E] an d our approach (equation ([SJ) both imply the principle of global 
regulation whereas the total population size is being regulated by internal or external means (see also 
[16] for discussion). The major difference between the local and global regulation approaches appears 
when a fate of an ESS of the local replicator system is studied. While in system ([6]) this stationary point 
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remains stable, in systems (|7|) and ([8]) this point can loose its stability through Turing's mechanism. 
The analysis of system ([8]) shows that this is probable when the diffusion coefficients are sufficiently 
small. 

The approach, adopted in our works OUT], allows for further generalizations of the notions of the 
Nash equilibria and ESS. In general, we can conjecture that the behavior of the distributed replicator 
equation of the form (JSj) mimics that of the local system (|3|) if the stability notion is replaced with a 
weaker notion of the stability in the mean integral sense. 

The reviewed approaches are not the only possible ways to study replicator equations with explicit 
space. A lot of work was devoted to the study of particular class of replicator equations arising in the 
area of mathematical models of prebiotic evolution |10t 123] . In particular, appearance of spiral ways 
was studied by means of numerical simulations of some partial differential equations |15l [To] \T7\ [TBT [T9] 
and cellular automata [2] [3] U [5j [6] . These approaches are complementary to those considered in this 
short note. It is also possible to consider evolutionary systems with discrete state space (e.g., [Tl [2"4"l[3"6] ) 
but in general the better elaborated theory of reaction-diffusion equations allows deaper analytical 
insights into the behavior of replicator equations with explicit spatial structure. 
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